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METHOD AND SYSTEM FOR USING IDLE THREADS TO ADAPTIVELY 

THROTTLE A COMPUTER 

Field of the Invention 

The present invention relates generally to computer-executable software, 
and more particularly to computer-executable software that controls the performance of 
a computer. 

Background 

Generally, the faster a CPU runs, the more power the CPU consumes. 
When a CPU consumes more power, it uses more electricity and generates more heat. 
With desktop computers, using more power increases energy costs and cooling costs 
and causes computer manufacturers to spend more money designing and building 
systems to supply more power and dissipate more heat. This results in computers more 
expensive to build and operate. 

In addition to these energy, design, and construction costs, portable 
computer users have additional disadvantages associated with CPU power consumption. 
When operating on battery power, the more power a CPU consumes, the less time the 
computer can operate without recharging the battery. Buying a bigger, heavier battery 
adds additional expense and weight to a portable computer. In addition, typically, a 
bigger battery does not reduce the heat the CPU produces. Reducing power 
consumption by using a slower CPU, on the other hand, also has disadvantages. A 
slower CPU reduces the overall performance of the portable computer and makes the 
portable computer less of a viable replacement for a desktop computer. 

Summary 

The present invention is directed at providing a system and method for 
decreasing CPU power consumption while maintaining CPU performance. In 
accordance with a brief statement of the invention, prior CPU utilization is measured 
when the CPU is idle. For example, a usage determination procedure may be executed 
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when the operating system has run out of work to perform. If CPU utilization warrants 
more processing speed, the CPU is instructed to increase processing speed, if possible. 
If CPU utilization indicates that less CPU processing speed could adequately fulfill 
processing needs, the CPU is instructed to decrease processing speed to consume less 
5 power. Lowering or increasing processing speed may also be affected by CPU 
temperature limits, battery considerations, and/or system policies. 

In one aspect of the invention, CPU utilization is calculated when the 
CPU has no other executable tasks to perform. Then, depending on the CPU utilization, 
the CPU performance level is increased, decreased, or remains the same. 
10 In another aspect of the invention, after CPU utilization is calculated, 

system policies are applied to determine whether to increase or decrease the CPU 
performance level. These system policies may include thermal and battery 
considerations. If the CPU utilization indicates that a different CPU performance level 
may be more appropriate and/or if the system policies dictate or allow a different CPU 



£0 15 performance, the CPU performance level is changed appropriately. 



q There are several advantages to the present invention. It provides a 

^ method for reducing power consumption with little or no change to perceived system 

« performance. By decreasing power consumption, devices that use battery power can 

:= = 

operate longer before needing a recharge or battery replacement. The method can 

j s * 20 operate during a computer's idle time and thus not add the overhead or inaccuracies in 

13 calculating idle time that a constant, periodic CPU utilization calculation and 



adjustment might add. 

Brief Description of the Drawings 

FIGURE 1 is a functional block diagram of one computing device 
25 adapted to implement one embodiment of the invention. 

FIGURE 2 is a functional block diagram illustrating a system adapted to 
throttle one or more CPUs to meet processing needs, according to one embodiment of 
the invention. 
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FIGURE 3 is a functional block diagram illustrating a system adapted to 
determine and set the appropriate levels of performances for one or more CPUs, 
according to one embodiment of the invention. 

FIGURE 4 is a diagram illustrating the power consumed by a CPU as the 
frequency and voltage of the CPU vary. 

FIGURE 5 is a diagram illustrating choices for processor performance 
level selections. 

FIGURE 6 is a state diagram illustrating various states for adaptively 
throttling a CPU, according to one embodiment of the invention. 

FIGURE 7 is a logical flow diagram illustrating a process for 
determining whether a CPU performance level should be modified, and, if so, 
modifying it, according to one embodiment of the invention. 

FIGURE 8 is a logical flow diagram illustrating a process to determine 
whether a CPU performance level should be changed, according to one embodiment of 
the invention. 

FIGURE 9 is a logical flow diagram illustrating a process to determine if 
CPU utilization justifies an increase in CPU performance level, according to one 
embodiment of the invention. 

FIGURE 10 is a logical flow diagram illustrating a process to determine 
if CPU utilization justifies a decrease in the CPU performance level, according to one 
embodiment of the invention. 

Detailed Description 

The present invention provides a method and system for adaptively 
throttling a computer during the computer's idle times. First an illustrative operating 
environment for practicing the invention is disclosed. Then, an illustrative system for 
implementing an embodiment of the invention is described. Following the illustrative 
operating environment and system are disclosed illustrative methods for using the 
illustrative environment and system to adaptively throttle the computer. 



Illustrative Operating Environment 

With reference to FIGURE 1, an exemplary system for implementing the 
invention includes a computing device, such as computing device 100. In a very basic 
configuration, computing device 100 typically includes at least one processing unit 102 
5 and system memory 104. Processing unit 102 includes existing physical processors, 
those in design, multiple processors acting together, virtual processors, and any other 
device or software program capable of interpreting binary executable instructions. 
Depending on the exact configuration and type of computing device, system 
memory 104 may be volatile (such as RAM), non-volatile (such as ROM, flash 
10 memory, etc.) or some combination of the two. System memory 104 typically includes 
an operating system 105, one or more program modules 106, and may include program 
data 107. This basic configuration is illustrated in FIGURE 1 by those components 
O within dashed line 108. 

I'S Computing device 100 may also have additional features or 

;™ 15 functionality. For example, computing device 100 may also include additional data 

iy 

□ storage devices (removable and/or non-removable) such as, for example, magnetic 

disks, optical disks, or tape. Such additional storage is illustrated in FIGURE 1 by 
removable storage 109 and non-removable storage 110. Computer storage media may 
include volatile and nonvolatile, removable and non-removable media implemented in 
20 any method or technology for storage of information, such as computer readable 
instructions, data structures, program modules or other data. System memory 104, 
removable storage 109 and non-removable storage 110 are all examples of computer 
storage media. Computer storage media includes, but is not limited to, RAM, ROM, 
EEPROM, flash memory or other memory technology, CD-ROM, digital versatile disks 
25 (DVD) or other optical storage, magnetic cassettes, magnetic tape, magnetic disk 
storage or other magnetic storage devices, or any other medium which can be used to 
store the desired information and which can be accessed by computing device 100. Any 
such computer storage media may be part of device 100. Computing device 100 may 
also have input device(s) 112 such as keyboard, mouse, pen, voice input device, touch 
30 input device, etc. Output device(s) 114 such as a display, speakers, printer, etc. may 
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also be included. All these devices are known in the art and need not be discussed at 
length here. 

Computing device 100 may also contain communications 
connection(s) 116 that allow the device to communicate with other computing 
5 devices 118, such as over a network. Communications connection(s) 1 16 is an example 
of communication media. Communication media typically embodies computer readable 
instructions, data structures, program modules or other data in a modulated data signal 
such as a carrier wave or other transport mechanism and includes any information 
delivery media. The term "modulated data signal" means a signal that has one or more 
10 of its characteristics set or changed in such a manner as to encode information in the 
signal. By way of example, and not limitation, communication media includes wired 
media such as a wired network or direct-wired connection, and wireless media such as 

□ acoustic, RF, infrared and other wireless media. The term computer readable media as 

'2? used herein includes both storage media and communication media. 

<.y 

ffl 

m 15 Illustrative CPU Throttling System 

i!3 

G FIGURE 2 is a functional block diagram illustrating a system adapted to 

^ throttle one or more CPUs to meet processing needs, according to one embodiment of 

■t 

□ the invention. This embodiment of the invention includes system policies 202, 
j|V operating system 105 having CPU performance manager 300, temperature sensor 210, 
* ; n 20 battery charge sensor 215, CPU array 220, and battery 225. 

\,a System policies 202 include various configuration data for the system. 

The data is placed in and accessed from system policies 202 by operating system 105. 
Operating system 105 uses the data for many purposes including, for example, 
restricting or giving a user access to certain resources, optimizing system performance 

25 to provide for quick response time in the case of a system dedicated to a single user or 
more throughput on a system serving many users or computers, and requiring users to 
provide more-difficult-to-guess passwords. A policy existing for one type of 
computers, e.g., battery-powered computers, may not exist on another type of 
computers, e.g., alternating current (A/C) powered computers. Alternatively, the same 

30 policy may exist on various types of computers, e.g. on both battery-powered and A/C 
powered computers, but the policy may specify different actions for different 
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conditions, e.g. one set of actions when a computer is plugged into a power source and 
another set of actions when the computer is operating from battery power. 

A battery-powered computer may have policies in system policy 202 for 
controlling resources for various circumstances. For example, system policy 202 may 
include a policy that instructs operating system 105 to operate the hardware to 
maximize performance at all times, possibly at the expense of using additional battery 
charge. Alternatively, system policy 202 may include a policy that instructs operating 
system 105 to operate the hardware to use less battery charge, possibly at the expense of 
performance. There may be a policy that causes operating system 105 to slow a CPU if 
the temperature exceeds a threshold. A policy may result in degraded performance in 
response to lowering battery charge. System policies 202 may include a policy causes 
switching latencies of CPU array 220 to be considered by CPU performance 
manager 300 when determining whether to change a CPU's performance level. For 
example, if a CPU takes a relatively long time to change performance, the policy may 
direct CPU performance manager 300 to switch less often. System policies 202 may 
include these and/or other policies and may have policies added, changed, or removed 
as needed or desired. 

CPU array 220 includes one or more CPUs. The CPUs may be 
physically located together or communicating through connection(s) such as 
connection(s) 1 16 of FIGURE 1. The CPUs may be homogeneous, i.e. all of the same 
type, or heterogeneous, i.e. of different types. CPU array 220 is configured to execute 
computer-executable software, including operating system 105, and to vary processing 
speed in response to requests from operating system 105. 

Temperature sensor 210 is configured to measure the temperature of 
CPUs in CPU array 220 and to provide the measured temperature to operating 
system 105. In one embodiment of the invention, temperature sensor 210 measures the 
temperature of each CPU in CPU array 220. In another embodiment of the invention, 
temperature sensor 210 measures a temperature near CPU array 220. In yet another 
embodiment of the invention, temperature sensor 210 measures a temperature slightly 
related or unrelated to the temperature of the CPUs in CPU array 220. In some 
embodiments, temperature sensor 210 interrupts operating system 105 to indicate that 



the temperature has changed. In other embodiments, operating system 105 polls 
temperature sensor 210 to determine a change in temperature. 

Battery charge sensor 215 is configured to measure the charge remaining 
in battery 225 and provide this measurement to operating system 105. In one 
5 embodiment of the invention, battery charge sensor 215 interrupts operating system 105 
when the charge on battery 225 crosses a threshold. In another embodiment of the 
invention, operating system 105 periodically polls battery charge sensor 215 to 
determine the charge on battery 225, 

Operating system 105 is configured, among other things, to access 
10 system policies 202, to receive temperature information from temperature sensor 210, to 
receive battery charge information from battery charge sensor 215, and to cause CPU 
performance levels to change for CPU array 220. Operating system 105 includes CPU 

□ performance manager 300 which is described in more detail in conjunction with 
{ !q FIGURE 3. Briefly, CPU performance manager 300 determines when, based on 
CO 15 various data received by and/or contained in operating system 105, to request more or 

less CPU performance. 

Battery 225 provides power to the system of FIGURE 2. Generally, 

i! battery 225 includes any device which has a limited amount of energy that can be 

Q 

rfj provided to another device and in which the remaining amount of energy can be 

20 measured. In some embodiments of the invention, battery 225 includes a portable 

m 

□ battery typically provided with a portable computer. In other embodiments of the 
invention, battery 225 includes an uninterruptible power source which provides backup 
power when standard power sources are interrupted. In yet other embodiments of the 
invention, battery 225 includes a power generator that has a limited fuel supply. 

25 Battery 225 may simultaneously be providing power to other systems than the one 
described in FIGURE 2. 

In another embodiment of the invention, the system of FIGURE 2 is 
powered by an A/C source in addition to or in lieu of battery 225. When operating on 
A/C, a computer will not generally run out of power, but by selecting less CPU 

30 performance when the maximum CPU performance is not needed, for example, when 
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the computer is not being used, CPU performance manager 300 may reduce energy 
consumed and heat generated. 

FIGURE 3 illustrates in greater detail CPU performance manager 300 
which determines the appropriate levels of performances for one or more CPUs (not 
shown), hereinafter referred to as "the CPU". CPU performance manager 300 includes 
watch dog timer 3 10, CPU throttler 315, CPU utilization monitor 320, and CPU 
utilization history 330. The CPU performance manager may include thermal policy 
manager 305 and degradation policy manager 325. 

Thermal policy manager 305 is configured to receive the temperature 
information generated by temperature sensor 210 of FIGURE 2 and to provide a 
thermal CPU performance limit, if needed, to CPU throttler 315. The CPU that thermal 
policy manager 305 is receiving temperature information about may be hotter than 
appropriate. For example, the CPU may be operating in a hot room, or possibly, a fan 
cooling the CPU has failed. Under these conditions, continuing to operate the CPU at 
its current performance level may damage it. Thermal policy manager 305 determines 
if a harmful temperature situation is occurring and calculates an appropriate 
performance level for the affected CPU. 

Degradation policy manager 325 is configured to receive the battery 
charge information generated by battery charge sensor 215 of FIGURE 2 and to provide 
a battery CPU performance limit, if needed, to CPU throttler 315. Using policy 
information received from system policies 202, degradation policy manager 325 may 
determine, for example, that to maintain system operation for a specified period of time, 
the CPU should consume less power. To consume less power, the CPU may be 
instructed to decrease performance. Degradation policy manager 325 determines the 
degraded performance limit for the CPU and supplies this limit to CPU throttler 315. 

CPU utilization monitor 320 is configured to monitor the one or more 
CPU utilizations and to report the utilizations monitored to CPU throttler 315. CPU 
utilization monitor 320 may be activated by CPU throttler 315, watch dog timer 310, or 
by other components. Typically, CPU utilization monitor 320 is activated when a 
monitored CPU enters an "idle" state. The CPU may idle for a variety of reasons. For 
example, the CPU may have several tasks it is performing, but the CPU is waiting for 
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Input/Output (I/O) operations to complete. The CPU, for example, may be waiting for a 
user to respond to a prompt, a disk request to return data, or a network event to occur. 
In accordance with an embodiment of the invention, during this idle time, the CPU is 
instructed to calculate its utilization. 
5 Causing the CPU to calculate its utilization during idle time has many 

advantages. One advantage is that it avoids the overhead of a periodic utilization 
calculation. For example, if the CPU is instructed to calculate its utilization on a 
periodic basis, such as every few microseconds, the calculations may distract the CPU 
from other more-essential processing. If the CPU is busy with such other processing, 
10 taking frequent time outs to calculate utilization adds to the CPU's work load and slows 
the other processing. By having the CPU calculate its utilization during idle time, 
utilization statistics can be gathered without burdening the other processing. 

Watch dog timer 310 is configured to activate CPU throttler 315 after a 
timeout period. This is done to avoid some problems associated with activating CPU 
'§ 15 throttler 315 only when the CPU is idle. CPU utilization is often non-uniform. The 
;3 CPU often completes a computationally intensive task and finds that no more tasks are 

[S jf pending. The CPU then enters an idle state waiting for more tasks to arrive. During the 

ii idle state, CPU throttler 315 may reduce the CPU's performance level to reduce power 

l»p consumed and heat generated. Shortly thereafter, a long, computationally intensive task 

t? * 20 may arrive. The CPU, still set at the low performance level, begins working on the task. 

in 

□ The task may be such that at the current performance level, from the time the CPU 

receives the task to the time the task completes, the CPU never enters an idle state. If 
CPU throttler 3 1 5 is only activated during idle times, it would not have an opportunity 
to increase the CPU performance level to speed execution of the task. After the task 
25 completes, CPU throttler 315 may increase the performance level of the CPU (based on 
preceding utilization), but no tasks may be pending. So by only operating when the 
CPU enters the idle state, CPU throttler 315 may not be able to increase the CPU's 
performance level when needed and additionally may increase the CPU's performance 
level when it is not needed. By activating CPU throttler 315 after a time expires, watch 
30 dog timer 310 helps CPU throttler 315 avoid allowing the CPU to execute a 
computationally intensive task at a low performance level. 
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Watch dog timer 310 may be embodied as a "run once" timer. That is, 
after activating CPU throttler 315 once, watch dog timer 310 may be configured to not 
activate CPU throttler 315 again unless reset. 

CPU throttler 315 may be configured to reset watch dog timer 310 
whenever CPU throttler 315 is activated. For example, before the time expires on 
watch dog timer 310, CPU throttler 315 may be activated because the CPU has entered 
an idle state. Rather than have the time expire on watch dog timer 310 at the time 
originally set, CPU throttler 315 may reset watch dog timer 310 to have its time expire 
at a later time. CPU throttler 315 may be activated again by the CPU entering an idle 
state before the later time on watch dog timer 310 expires. Upon activation, CPU 
throttler 315 may again reset watch dog timer 310 to expire at another later time. This 
process may be repeated several times. The result is that time on watch dog timer 310 
only expires when the CPU is too busy to enter an idle state. A CPU is too busy to 
enter the idle state when it is fully utilized at its current performance level. When the 
CPU is fully utilized at its current performance level, however, it is a good indicator 
that a higher performance level for the CPU may be more appropriate. Thus, watch dog 
timer 310 typically only activates CPU throttler 315 when a task the CPU is working on 
could use higher performance. 

Furthermore, CPU throttler 315 may disable watch dog timer 310. For 
example, the CPU may be running at its maximum performance level. While the CPU 
is running at its maximum performance level, it is not necessary to determine whether it 
can run even faster. Furthermore, interrupting the CPU at this time is counter- 
productive as it consumes CPU processing power. Therefore, CPU throttler 315 may 
temporarily disable watch dog timer 310 without concern that a task could use more 
CPU processing power as the CPU is currently configured to deliver all processing 
power available. 

CPU throttler 315 may disable watch dog timer 310 for other reasons. 
For example, policies may dictate that given the CPU's temperature or the battery's 
charge, that the current CPU performance level is the highest performance level 
allowable. Until the temperature decreases, the battery charge increases, the policies 
change, or an idle state is reached and the performance level is lowered, there is no need 
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to spend processing power determining whether more processing power should be 
given. Thus, CPU throttler 315 may disable watch dog timer 310 until conditions 
change. 

CPU utilization monitor 320 is configured to calculate CPU utilization 
5 statistics and send the statistics to CPU throttler 315. Additionally, it may be 
configured to store CPU utilization statistics in CPU utilization history 330. Typically, 
CPU utilization monitor 320 is only activated when a CPU it is monitoring enters an 
idle state. CPU utilization monitor 320 may be activated at other times such as by 
watch dog timer 310 or when CPU throttler 315 requests CPU utilization statistics. 

10 CPU utilization monitor 320 may calculate CPU utilization in many 

different ways. For example, it may query the operating system for user time and 
kernel time within the last period. It may add these times together to compute total 
CPU time. Idle time divided by the total CPU time for the last period gives a 
percentage of time spent in the idle state. Utilization for the last period can be 

1 5 calculated by subtracting this percentage from one hundred percent. 

Alternatively, CPU utilization monitor 320 may itself tally user, kernel, 
and idle time. Then, using the preceding method, it may calculate an idle and/or a 
utilized percentage. CPU utilization monitor 320 may use any combination of tallying, 
querying, or other technique to determine idleness and utilization. 

20 CPU utilization history 330 is configured to send and receive CPU 

utilization statistics and store them for future use. CPU utilization statistics from CPU 
utilization history 330 may be used by CPU throttler 3 1 5 to determine when to change 
the CPU's performance level. 

CPU throttler 315 is configured to receive information from thermal 

25 policy manager 305, watch dog timer 310, CPU utilization monitor 320, degradation 
policy manager 325, CPU utilization history 330, and system policies (not shown). 
CPU throttler 315 is also configured to send information to watch dog timer 310, CPU 
utilization history 330, and the CPU (not shown). CPU throttler 315's primary function 
is to determine appropriate performance levels for the one or more CPUs it controls 

30 based on information received and system policies. CPU throttler 315 may activate 
CPU utilization monitor to gather CPU utilization statistics. Typically, CPU 
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throttler 3 1 5 is activated when a CPU enters an idle state, but it may also be activated at 
other times by any of the other components in FIGURE 3 or by other processes (not 
shown). For example, thermal policy manager 305 may determine that the temperature 
of the CPU is too high and may activate CPU throttler 315 to lower the CPU 
performance level to decrease heat generated. 

FIGURE 4 is a diagram illustrating the power consumed by a CPU as the 
frequency and voltage of the CPU vary. In many CPUs, the power consumed by a CPU 
is directly related to the frequency at which the CPU runs. For example, a CPU running 
at 200 MHz will typically consume twice the power of the same CPU running at 100 
MHz. On the other hand, typically, the power consumed by a CPU is directly related to 
the square of the voltage used by the CPU. For example, a CPU running at 2 volts will 
typically consume four times the power of the same CPU running at 1 volt. 

Generally, the frequency at which the CPU operates directly relates to 
the amount of work the CPU can accomplish in a given amount of time. To achieve 
higher frequencies, normally a CPU must operate at a higher voltage. At lower 
frequencies, however, the CPU may operate on a range of voltages. For power 
consumption, ideally, a CPU throttler would determine the performance level required 
(in frequency) and select the least voltage that would allow that frequency. This would 
result in less power consumption for the selected frequency. Most power supplies 
supplying voltage to the CPU, however, are not capable of a supplying a continuous 
range of voltages. For example, a power supply may be able to supply only three 
different voltages, such as Vj, V 2 , and V 3 as shown in FIGURE 4. Furthermore, 
frequency suppliers generally provide only a limited number of frequencies at which to 
operate the CPU (not shown). Therefore, a CPU throttler, such as CPU throttler 315, is 
often constrained to take into account the voltage levels and frequency settings 
available. 

Referring to FIGURE 4, the CPU operating at MHz 2 consumes less 
power if the voltage supplied is V 2 instead of V 3 . The CPU operating at MHzi 
consumes less power if the voltage supplied is V\ instead of V 2 or V3. At MHZ3, only 
V 3 is available. 
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Frequency modifications along the same voltage do not normally achieve 
much in the way of power conservation. For a given task, the CPU has a certain 
number of instructions to complete. Typically, if the CPU runs half as fast, it takes 
twice as long to complete the instructions. So, even though the CPU may be consuming 
5 half the power, it does so for twice as long which results in the same energy being 
consumed. In addition, as long as the CPU is operating, other devices such as a disk 
drive, device bus, memory, etc., may also be operating (and consuming power). The 
power consumed by these devices is less sensitive to the frequency of the CPU, i.e. 
these devices consume approximately the same amount of power whether the CPU is 
10 running fast or slow. As it takes longer to complete the task when running at a slower 
speed, even though the CPU consumes approximately its normal energy, the other 
devices consume twice the energy they would if the CPU were running at the faster 
speed. Thus, the total energy consumed to complete the task at the slower CPU rate is 
i;p more than the energy consumed at the faster CPU rate. 

|;H 15 If the CPU completes the task as quickly as possible, on the other hand, 

□ it may be able to enter a power saving mode while waiting for the next task. During the 

power saving mode, it may be able to conserve power consumption on the other 
devices, e.g. by shutting down the hard drive, turning off the fan, etc., thus reducing the 
\Tt power consumption even more. At the same time, the task is completed more quickly 

j ^ 20 and the computer appears more responsive to a user. Completing a task at the faster 
frequency setting for a given voltage is known as race to wait. 

Briefly stated, CPU performance manager 300 of FIGURE 3 typically 
maintains the highest frequency for the selected CPU voltage, causing the CPU to race 
to wait at that frequency. If more power savings are needed and/or other policies 
25 dictate, a lower voltage is chosen. When the lowest voltage available for the CPU has 
been selected, then the frequency may be decreased below the maximum available for 
that voltage if necessary to satisfy a policy such as a thermal policy. 

Note that CPU performance manager 300 may also take into account the 
time it takes to switch a voltage or frequency (switching latency) in determining 
30 whether the voltage or frequency should be changed to increase or decrease CPU 
performance. For example, if a voltage change has a relatively long switching latency, 
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CPU performance manager 300 may cause voltage changes less frequently to avoid the 
time lost while changing the voltage. Policies regarding performance level changing as 
it relates to the length of time it takes to change a performance level may be contained 
in a policy in system policies 202 of FIGURE 2. 

FIGURE 5 is a diagram illustrating proper and improper choices for 
processor performance level selections. In time period To, the processor performance 
level varies frequently between Pi and P2. This may be caused by an over-aggressive 
CPU throttler that immediately throttles the CPU as soon as the CPU enters an idle 
state. Changing the processor performance level may take a considerable amount of 
time. During the change, the processor is unavailable to execute instructions. 
Consequently, processor performance may suffer, for instance, a DVD playback 
proceeding on the computer may skip a frame or a soft modem may lose a connection 
because the CPU did not respond in time to complete a needed operation. Such an 
occurrence may frustrate a user and should generally be avoided. 

In time period Ti, the processor performance level varies less frequently 
between Pi and P2. With this less frequent level change, fewer DVD frames are lost and 
a soft modem will typically lose fewer connections. Generally, this is the desired 
response from CPU performance manager 300. CPU performance manager 300 
accomplishes this less frequent level change in part by applying the system policies to 
information received from CPU utilization monitor 320 and CPU utilization history 330 
as discussed in detail in conjunction with FIGURE 7-10. 

Illustrative CPU Throttling Methods 

FIGURE 6 is a state diagram illustrating various states involved in 
adaptively throttling a CPU, according to one embodiment of the invention. The 
process begins in block 600, when the CPU is ready to execute work. 

At block 600, as long as there is work the CPU can execute, the CPU 
executes the work. As discussed previously in conjunction with FIGURE 3, sometimes 
the CPU may be performing a task, but it is waiting for I/O operations to complete. 
Typically, until the I/O operation completes, the CPU should not execute the next part 
of the task. The CPU may have work in other tasks it can execute. Sometimes, 
however, all tasks are waiting for I/O operations to complete. Alternatively, the CPU 
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may have completed the pending tasks. At any such points, the CPU enters an idle 
state. For example, referring to FIGURE 2, a CPU in CPU array 220 continues working 
on tasks until each task contains no executable work or until all tasks are complete. 
When the CPU idles, processing continues at block 605. 
5 Alternatively, a timer, such as watch dog timer 310, may expire before 

the CPU enters an idle state. In this case, processing continues at block 610. For 
example, referring to FIGURE 3, watch dog timer 310 activates CPU throttler 315 since 
the timeout occurred before an idle state activated CPU throttler 315. 

At block 605, the idle thread is executed. Idle does not mean that the 
10 CPU is doing nothing. The CPU may be polling for work to do or seeing if any 
deferred procedure calls are pending. For example, referring to FIGURE 2, a CPU in 
CPU array 220 executes work in operating system 105 to determine if more tasks are 
available. After block 605, processing continues at block 610. 
S At block 610, the timeout timer may be reset. If block 610 was reached 
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j;| 15 from block 605, this indicates that utilization was checked before the time expired and 

□ avoids a needless utilization check in future processing. If block 610 was reached 
because of a timeout from block 600, this typically indicates that the CPU was fully 
utilized at its current performance level and that an increased performance level may be 
appropriate. As previously mentioned in conjunction with FIGURE 3, for various 

|'I 20 reasons including, for example, if the CPU is already performing at a maximum 

□ performance level, the CPU throttler 315 may determine to not reset watch dog 
timer 310. For example, referring to FIGURE 3, CPU throttler 315 resets watch dog 
timer 3 10, if appropriate. After the timeout timer is reset, if needed, processing 
continues at block 615. 

25 At block 615, CPU throttling processes are activated as described in 

detail in conjunction with FIGURE 7. Briefly stated, CPU utilization for the prior 
period is calculated and policies are applied to determine if the CPU performance level 
should increase, remain the same, or decrease. If it is determined that the CPU 
performance level needs adjustment, this is done at this time. Referring to FIGURE 3, 

30 CPU throttler 315 uses information from thermal policy manager 305, CPU utilization 
monitor 320, degradation policy manager 325, CPU utilization history 330, and system 
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policies (not shown) to determine if the CPU performance level should increase, 
decrease, or remain the same. If the CPU performance level should change, CPU 
throttler 315 sends signals to change the CPU performance level. After block 615, if no 
executable instructions are available, processing returns to block 605. Otherwise, 
processing returns to block 600. 

The process of FIGURE 6 continues as long as the operating system 
continues to execute on the computer. 

FIGURE 7 is a logical flow diagram illustrating a process for 
determining whether a CPU performance level should be modified, and, if so, 
modifying it. The process starts at block 700 after it is determined that CPU utilization 
should be checked and the CPU performance level possibly modified. 

At block 705, promotion/demotion calculations are performed to 
determine whether the CPU performance level should increase, decrease, or stay the 
same. These calculations are described in more detail in conjunction with FIGURE 8. 
Briefly stated, utilization is calculated and if it exceeds a threshold and other criteria are 
satisfied, a promotion flag is set. If utilization is less than a threshold and other criteria 
are satisfied, a demotion flag is set. In another embodiment of the invention, rather than 
setting a flag, a desired CPU performance level may be calculated. For example, 
referring to FIGURE 3, CPU utilization monitor 320 calculates the CPU's utilization, 
possibly stores the utilization in CPU utilization history 330, and sends the utilization 
statistics to CPU throttler 315. 

At block 710, system policies are applied to determine whether the CPU 
performance level should be changed. Such policies include temperature of the CPU, 
battery charge left, etc. as previously discussed. In one embodiment of the invention, 
system policies may indicate that the CPU performance level should be greater than, 
less than, or equal to the desired CPU performance level indicated by the 
promotion/demotion calculation of block 705. For example, referring to FIGURE 3, 
thermal policy manager 305 and degradation policy manager 325 apply system policies 
to determine if the CPU performance level should be changed. Then, they pass this 
information to CPU throttler 315. 
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In another embodiment of the invention, system policies are applied but 
can only keep the same or decrease the performance level from that calculated at 
block 705. For example, even though prior CPU utilization indicates that an increased 
CPU performance level may speed processing, in order to avoid a temperature problem, 
5 thermal policy indicates that the CPU performance level should not be increased. In 
order to conserve battery charge, battery charge policy may indicate that the CPU 
performance level should be decreased even further. Thus, at block 705 a "high water 
mark" of CPU performance level may be set, and at block 710, system policies may 
dictate a lower CPU performance level. 
10 At block 715, the CPU performance level is changed if promotion or 

demotion flags are set and/or if system policies dictate. For example, referring to 
FIGURE 3, CPU throttler 315 sends control signals to increase the performance level of 

□ the CPU because CPU utilization is high, CPU temperature is acceptable, and battery 
charge is sufficient. 

15 At block 720, processing ends and the CPU's performance level has been 

ru 

Q changed, if needed. 

.-.^ FIGURE 8 is a logical flow diagram illustrating calculations performed 

to determine whether a CPU performance level should be increased, decreased, or 

Q 

tjl remain the same, according to one embodiment of the invention. The process starts at 

j 20 block 800 when a promotion/demotion determination is needed. 

□ At block 805, the CPU utilization is calculated. For example, referring 
u 

to FIGURE 320, CPU utilization monitor 320 calculates the CPU utilization during the 
previous period, possibly stores the utilization statistics in CPU utilization history 330, 
and sends the utilization statistics to CPU throttler 315. 

25 At block 810, a determination is made as to whether promotion criteria 

are met. When promotion criteria are met, CPU utilization indicates that an increased 
CPU performance level may be appropriate. This determination is described in more 
detail in conjunction with FIGURE 9. For example, referring to FIGURE 3, CPU 
throttler 315 determines, based on the utilization statistics received from CPU 

30 utilization monitor 320, whether promotion criteria are met. If promotion criteria are 
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met, the yes branch is taken and processing continues at block 820. Otherwise, the no 
branch is taken and processing continues at block 825. 

At block 820, a promotion flag is set indicating that promotion criteria 
have been met, i.e. prior CPU utilization justifies an increase in the CPU performance 
5 level. For example, referring to FIGURE 3, CPU throttler sets a flag (not shown) 
indicating that promotion criteria have been met. 

At block 825, a determination is made as to whether demotion criteria 
are met. When demotion criteria are met, prior CPU utilization indicates that a 
decreased CPU performance level may be appropriate. This determination is described 
10 in more detail in conjunction with FIGURE 10. For example, referring to FIGURE 3, 
CPU throttler 315 determines, based on the utilization statistics received from CPU 
utilization monitor 320, whether demotion criteria are met. If demotion criteria are met, 
the yes branch is taken and processing continues at block 835. Otherwise, the no 
jlj: branch is taken and processing continues at block 840. 

CO 15 At block 835, a demotion flag is set indicating that demotion criteria 

ru 

q have been met, i.e. prior CPU utilization justifies a decrease in the CPU performance 

.ijj level. For example, referring to FIGURE 3, CPU throttler sets a flag (not shown) 

» indicating that demotion criteria have been met. 

!□ 

j ; fj At block 840, processing ends. At this point, a promotion or a demotion 

20 flag has been set if prior CPU utilization justifies an increase, respectively, or decrease 
Q in the CPU performance level. The flag set may be the CPU performance level 

appropriate for the prior state of CPU utilization. In other words, the flag is not limited 
to a Boolean value and may include a numerical value representing a desired CPU 
performance level. 

25 Furthermore, the flag may indicate that the CPU performance level 

should be changed more than one performance level from where it currently is. For 
example, the CPU may have just completed a computationally intensive task and have 
no additional tasks pending. During the past period, CPU utilization may have been 
zero percent. Rather than adjusting one CPU performance level down after a first 
30 utilization check and another performance level down after another utilization check, 
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the flag may be set to indicate that the CPU performance level should be set at its 
lowest level. 

FIGURE 9 is a logical flow diagram illustrating a process to determine if 
prior CPU utilization justifies an increase in the CPU performance level, according to 
one embodiment of the invention. The process enters at block 900 from decision 
block 810 of FIGURE 8, after prior CPU utilization has been calculated. 

At block 905, a determination is made as to whether the CPU 
performance level has been at its current level long enough. The purpose of this logic is 
to avoid the problems associated with frequent transitions as described in conjunction 
with FIGURE 5. Some experimentation may be necessary to determine an appropriate 
amount of time the CPU performance level should remain the same. Furthermore, the 
time the CPU performance level should remain the same may be longer before a 
transition to a lower CPU performance level than before a transition to a higher CPU 
performance level. In other words, how long a CPU throttler should wait before 
decreasing a CPU performance level may be longer than how long the CPU throttler 
should wait before increasing the CPU performance level. 

The difference in time between increasing and decreasing the CPU 
performance level may be set to satisfy user tastes. The user may prefer that when a 
computational intensive task is given to the CPU, that the CPU performance level 
quickly ramp up to complete the task as this typically decreases the time the user must 
wait for the task to complete. Furthermore, a user may prefer that a computer err on the 
side of maintaining a high CPU performance level longer rather than aggressively 
decreasing the CPU performance level when the CPU becomes idle so that the system 
remains responsive to the user's requests. In light of this disclosure, those skilled in the 
art will recognize that many schemes with varying time waits before CPU performance 
level changes may be implemented without departing from the spirit and scope of this 
invention. 

Continuing at block 905, if the CPU performance level has been at the 
same level long enough the yes branch is followed and processing continues at 
block 910. If the CPU performance level has not been at the same level long enough, 
the no branch is followed and processing continues at block 920. For example, 
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referring to FIGURE 3, CPU throttler 315 uses information from CPU utilization 
history 330 to determine whether the CPU performance level has been at the same level 
long enough. 

At block 910, it is determined whether the CPU utilization exceeds a 
5 threshold or not. The threshold may be set at a value near the maximum CPU 
utilization at the current CPU performance level. For instance, if the CPU utilization is 
not close to the maximum CPU utilization for the current CPU performance level, the 
current CPU performance level is not being fully utilized so there is likely no need to 
increase the CPU performance level. For example, referring to FIGURE 3, CPU 
10 throttler 315 uses the information received from CPU utilization monitor 320 to 
determine if the utilization exceeds the threshold. If the CPU utilization exceeds the 
threshold, the yes branch is followed to block 915. If the CPU utilization does not 
exceed the threshold, the no branch is followed to block 920. 

At block 915, the promotion criteria have been met. Further calculations 

i;u 

13 15 can use this information to act appropriately. For example, referring to FIGURE 3, 

m 

CPU throttler 315 determines that the promotion criteria have been met and sets a 
^ promotion flag (not shown). 

u At block 920, the promotion criteria have not been met. Further 

calculations can use this information to act appropriately. For example, referring to 

!'~ 20 FIGURE 3, CPU throttler 315 determines that the promotion criteria have not been met 

Lfl 

p and clears a promotion flag (not shown). 

At block 925, the process returns to block 825 of FIGURE 8. At this 
point, it is known whether the promotion criteria have been met. 

FIGURE 10 is a logical flow diagram illustrating a process to determine 
25 if prior CPU utilization justifies a decrease in the CPU performance level, according to 
one embodiment of the invention. The process enters at block 1000 from decision 
block 825 of FIGURE 8, after the prior CPU utilization has been calculated. 

At block 1005, a determination is made as to whether the CPU 
performance level has been at its current level long enough. The purpose of this logic is 
30 to avoid the problems associated with frequent transitions as described in conjunction 
with FIGURE 5. Some experimentation may be necessary to determine an appropriate 
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amount of time the CPU performance level should remain the same as described in 
conjunction with FIGURE 9. If the CPU performance level has been at the same level 
long enough the yes branch is followed and processing continues at block 1010. If the 
CPU performance level has not been at the same level long enough, the no branch is 
followed and processing continues at block 1020. For example, referring to FIGURE 3, 
CPU throttler 315 uses information from CPU utilization history 330 to determine 
whether the CPU performance level has been at the same level long enough. 

At block 1010, it is determined whether the prior CPU utilization is less 
than a threshold. Typically, the threshold is set somewhat lower than the maximum 
CPU utilization at the current CPU performance level. If the threshold for decreasing 
the CPU performance level (the lower threshold) is too close to the threshold for 
increasing the CPU performance level (the upper threshold), a CPU throttler may 
continually fluctuate between a higher and a lower CPU performance level. In other 
words, putting some distance between the lower and upper thresholds helps avoid the 
CPU performance level oscillation problems discussed in conjunction with FIGURE 5. 

To further explain the problems associated with setting thresholds too 
close to each other, consider a DVD playback that on average consumes 79% of total 
available performance from the CPU but occasionally consumes 84% and occasionally 
consumes 76%. Also, assume that a computer must use one CPU performance level to 
utilize 80-100% of the CPU and another CPU performance level to utilize 70-79% of 
the CPU. If an upper threshold is set at 79% and a lower threshold is set at 78%, the 
computer may skip several DVD frames because of constantly changing the CPU 
performance level in response to continually crossing the upper and lower thresholds. If 
the upper threshold is set at 79% and the lower threshold is set at 75%, once the higher 
CPU performance level is reached, there will be no transitions to the lower CPU 
performance level (as the 75% threshold is not crossed) and DVD frames will likely not 
be skipped. For example, referring to FIGURE 3, CPU throttler 315 uses the 
information received from CPU utilization monitor 320 to determine if the utilization is 
less than the lower threshold. If so, the yes branch is followed to block 1015. 
Otherwise, the no branch is followed to block 1020. 
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At block 1015, the demotion criteria have been met. Further calculations 
can use this information to act appropriately. For example, referring to FIGURE 3, 
CPU throttler 315 determines that the demotion criteria have been met and sets a 
demotion flag (not shown). 

At block 1020, the demotion criteria have not been met. Further 
calculations can use this information to act appropriately. For example, referring to 
FIGURE 3, CPU throttler 315 determines that the demotion criteria have not been met 
and does not set a demotion flag (not shown). 

At block 1025, the process ends. At this point, it is known whether the 
demotion criteria have been met. 

The various embodiments of the invention may be implemented as a 
sequence of computer implemented steps or program modules running on a computing 
system and/or as interconnected machine logic circuits or circuit modules within the 
computing system. The implementation is a matter of choice dependent on the 
performance requirements of the computing system implementing the invention. In 
light of this disclosure, it will be recognized by one skilled in the art that the functions 
and operation of the various embodiments disclosed may be implemented in software, 
in firmware, in special purpose digital logic, or any combination thereof without 
deviating from the spirit and scope of the present invention as recited within the claims 
attached hereto. 

The above specification, examples and data provide a complete 
description of the manufacture and use of the composition of the invention. Since many 
embodiments of the invention can be made without departing from the spirit and scope 
of the invention, the invention resides in the claims hereinafter appended. 
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